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THE FREQUENCY FUNCTION 


Given the distribution function and what can said the distribution 
the product zy? The author has had two inquiries during the last two years, 
one from investigator business statistics and the other from psychologist, 
concerning the probable error the product two quantities, each known 
probable error. There seems very little the literature mathematical 
statistics this question. 

and are independent and are each distributed according the same 
normal frequency law, well known that the distribution function 


Mz Y— 


Tv 


which the Bessel function the second kind purely imaginary 
argument zero order.2 and are independent and are each distributed 
according logarithmic normal frequency law, has been pointed out that 
the product, b), which and are the upper (or lower) limits 
the range for and respectively, distributed according law the 
same type.* both cases the special choice origins greatly simplifies the 
problem. 

the present discussion will assumed that and are distributed 
normally. will appear that the distribution function the 
coefficient correlation between and and the parameters, 


and 
Or 02 Cy 


which are proportional the reciprocals the coefficients variation. The 
chief difficulty arises when and are small that zero values occur 


Wishart and Bartlett: The Distribution Second Order Moment Statistics 
Normal System; Proceedings the Cambridge Philosophical Society, Vol. XXVIII 
(1932), pp. 455-459. 

2G. Watson: Treatise the Theory Bessel Functions; Cambridge University 
Press (1922), 78. 

Yuan: the Logarithmic Frequency Distribution and the Semi-logarithmic 
Frequency Surface; Annals Mathematical Statistics, Vol. (1933), pp. 46, 47. 
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for values and well within their respective ranges variation. (If 
and are large, practically one may exclude zero values and from con- 
sideration. The author hopes present investigation this case soon.) 
the object the present paper study the rather unusual frequency 
function that arises this situation. will first assumed that and 
are independent (rz, 0). Then will shown that the distribution 
function when readily derived from that arrived the special case. 


can find the moment generating function without difficulty. 
have, 


Setting, for convenience, 


this can written, 


This choice variable and parameters will adhered the sequel. 


expanding log powers get for the semi-invariants (of 
Thiele), 


(2) 2k) 


These give for the mean and variance zy, 


For the standard semi-invariants (or have, 


(2k 1)! pipe 


2 


2 k 


ig, 


Taking, 


For either the distribution symmetrical about its mean 
which then falls the origin. 


For the excess kurtosis, have, 


Thus the skewness never great and becomes small with increasing 
The excess also becomes small with increasing p2, but can very large 
for small values these parameters, attaining its maximum for 
But, will appear below, the distribution function always becomes infinite 
logarithmic manner the origin. (We have already seen, must ob- 
viously the case, that moments all orders exist.) noted, too, 
that for any given and increases without limit with increasing and 
that the same true neither nor zero. 

Turning now the derivation the actual frequency function set 


These values are substituted into dy, which and 
are the frequency functions and respectively, and the resulting 


expression integrated over all values giving for the frequency function 


which, 


Again setting and introducing the parameters and pe, this reduces to, 


if 
il 
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which, 


and the integral the same function over the interval 
Now writing, 


note that 


can expanded Laurent series powers for all values except zero. 
may note parenthetically that 


which the Bessel function the first kind with purely imaginary 


Setting now, 


substitute this series (6) and seek justify the expansion gives for 
obtained term term integration. write, 


z2 


z2 


Watson, loc. cit., 77. 


al 
i 
ha 


gence 


sufficient allow term term integration the first integral. Inthe second 
integral observe that converges uniformly every fixed interval 
Then term term integration permissible here 


0 


evident, then, that will sufficient establish the 
convergence 


dz. 


are still absolutely convergent which sufficient. 

Now using the definition the Bessel function purely imaginary argu- 
ment the second kind, 


easy derive the relation, 


0 


Remembering that K,(z) have for our expansion, 


which the argument for all the and for all the K-func- 
tions 


Bromwich: Introduction the Theory Infinite Series; Macmillan Co., 
London, 2nd edition (1926), pp. 496 and 500. 
Watson, loc. cit., pp. and 183. 
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But may well add this the expansion which may 
written, 


and obtain the expansion, 


2 2 
PitPpe 


the convergence which will examine. But must noted that the 
terms arising from the expansion 


z 
PL 


which contribute the expansion F(z) written are those the forms, 


Hence the expansion written valid any case only forz Forz 
may write however, 


which the arguments for the and K-funciions are the same before. 


Let consider now the question the convergence (8), first the case 


Then from the relation, 


(9) 


readily derive, 


Watson, loc. cit., 79. 


3 | —pir—p2 2 
z 

and 


For the left hand member and are both Thus 


Then let 


and have, 


for vo. 
Further since 


the convergence sought follows for Since even function 
possesses logarithmic discontinuity the origin. 

calculate ordinates F(z) there are fairly extensive tables available 
Watson’s treatise already referred to. These tables may readily extended 
means the asymptotic formula for for larger values and means 
(9) for larger values One can rapidly build tables means 
the easily obtained recursion formula, 


unfortunately true that the expansion found for F(z) very slowly 
convergent for large values and 

the end this paper are shown three charts F(z) with the tables 
ordinates from which they were made way illustrating what such curves 
look like. (On the second for comparison the broken line the normal curve 
error.) 


For the curve symmetrical about its mean (and the 
origin). Here every unity. 

20. Values and for 3.2 and 3.4 were also used. Not 
more than five terms (8) were required obtain values F(z) accurate 
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five places decimals. This distribution curve skew with 0.25 


and 


The curves are plotted standard units with unit total area 

Turning now the case which after some computation, have 
for the moment generating function, 


which may readily verified the moment generating function 


obtain the semi-invariants this case, expanding log 


‘powers setting 


have, 
(11) 


i 2 3 


from which derive, 


(12) 


. 


particular, 


3 


Noting that 


one can easily demonstrate what seems rather striking property these 
semi-invariants, viz., 


OAn:z 


(14) 


gain notion the magnitude the skewness and excess this case, 
form, 
2 
2:8 


view the above property, 


d, 


The denominator this fraction always The numerator, after some 
reduction, can written, 


The first two terms taken together, the third, and the last are all obviously 
The term, 


(15) 
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has its maximum value But for (15) becomes, 


both which expressions are easily seen 
Thus (15) always positive and the maximum value attained for 


the minimum value —1. These values are respectively, 


the absolute value either being which attained the first case 
for and the second for seen that for high correlation 
between and the skewness can quite large. 


For the excess, see that 


this such extraordinary value does not seem worth while carry out 
the extended computation that seems required verify one’s surmise 
that this the maximum the absolute value. 


and then 


which, 


e 
and the integral the same function over the interval 0). 


2 2 


Setting, 


4 


this becomes, 


But writing, 


the integral the last expression the same form the the un- 


correlated case. evident, then, that the distribution function can 
written, 


and essentially the form F(z), reached when multiplied 
exponential function. 


Frequency curves for (in standard units) are given Fig. Fig. and 


Fig. 
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TABLES ORDINATES THE DISTRIBUTION F(z) AND F(t) 


(Curve symmetrical with respect (Curve symmetrical with respect 
origin) origin) 

z=t F(z) F(t) F(z) F(t) 
0.1 0.77256 0.1 0.58215 0.07 0.82328 
0.3 .43887 0.3 
0.4 0.4 .31736 
0.6 0.24749 0.6 0.24270 0.42 0.34323 
1.2 0.10138 1.2 0.12595 0.85 0.17812 
1.4 .07756 1.4 0.99 
1.8 1.8 .07069 1.27 
2.0 .03625 2.0 .05873 1.41 
2.4 2.4 0.04078 1.70 
2.8 2.8 .02846 1.98 
3.2 .00878 3.2 .01992 2.26 .02818 
3.6 .00557 3.6 .01397 2.55 .01976 
4.0 4.0 .00981 2.83 .01388 
4.8 0.00146 4.8 0.00485 3.39 
5.6 .00061 5.6 .00239 3.96 .00338 
6.4 6.4 .00118 4.53 .00167 
7.2 .00011 7.2 .00058 5.09 
8.0 8.0 5.66 
9.0 9.0 0.00012 6.36 0.00017 
10.0 .00001 10.0 .00005 7.07 .00007 
11.0 7.78 
12.0 .00001 8.49 .00001 


} 
q 
| 


F(t) 
0.00001 0.00001 


—4.0 0.00311 —3.47 0.00381 
—3.6 —3.14 .00598 
—2.82 
—2.8 —2.49 
—2.4 —2.16 


—2.0 —1.84 
—1.6 —1.51 
—1.2 .08809 —1.18 


—0.2 0.47388 —0.37 0.58036 


0.1 0.68106 —0.12 0.83409 
0.2 —0.04 .63619 


0.4 0.36322 0.12 0.44484 
1.6 .09621 1.10 
2.0 .06614 1.43 .08100 


2.4 0.04589 1.76 0.05620 
2.8 2.08 .03920 
3.2 2.41 
3.6 .01571 2.74 
4.0 
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4.8 0.00545 3.72 0.00667 
5.6 4.36 .00329 
6.4 5.02 
5.67 .00080 
8.0 .00032 6.33 .00039 
8.8 0.00016 6.98 0.00020 
9.6 .00008 .00010 
10.4 8.29 
11.2 
12.0 9.59 
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NEW EXPOSITION AND CHART FOR THE PEARSON SYSTEM 
FREQUENCY CURVES 


the course some years teaching classes mathematical statistics, 
the author has expanded the treatment the Pearson system frequency 
functions begun the Handbook Mathematical into exposition 
that believes possesses marked advantages unity, clarity, and elegance. 
This accomplished expressing the variable standard units throughout 
and making the two parameters a3(a} Pearson’s notation) 
and 


a,+3 


fundamental the discussion. The various formulae that arise are obtained 
directly and uniform manner and are relatively simple form and easy 
use. The criteria for the different members the system functions are 
expressed very simply terms and and the chart corresponding the 
extension the Rhind diagram given takes strikingly simple 
form. 

Following the beginning made the Handbook, the system Pearson 
frequency functions are found among the solutions the differential 
equation 


(1) 
ydt 


For those solutions f(t) for which, 


1H. Rietz, Editor-in-Chief; Houghton-Mifflin Co., Boston (1924). See the chapter 

The notation used that the Handbook, loc. cit., which reference will fre- 
quently made. The discussion Robert Henderson, ‘‘Frequency Curves and 
Transactions the Actuarial Society America, Vol. VIII (1904), pp. 30-41, also proceeds 
along very similar lines, although Professor Carver was quite unaware when wrote 
his chapter the Handbook. The notation the Handbook seems preferable however. 

Karl Pearson: Mathematical Contributions the Theory Evolution, XIX. Second 
Supplement Memoir Skew Variation; Proc. Roy. Soc., Vol. 216 (1916), plate 
opposite 456. 
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CHART FOR PEARSON SYSTEM FREQUENCY CURVES 


and are the extremes the range variation for and for which the 
first moments over this range exist, the recursion formula for moments, 


can derived. Then setting get the following expressions 


valid except when Below note will taken those solutions for 
which the conditions imposed deriving (2) are not satisfied. The case 
which will included the discussion the transitional types 
functions. 

useful note that 


show this, using well-known device, see that 


never negative since f(t) for any real This requires that 


But 


w 


and the result follows. One consequence this that cannot vanish for 

any Pearson frequency function possessing moments the fourth order. 
Turning now the integration (1) and the development the various 

forms f(t) that arise, useful make the preliminary statements: 

The area under curve f(t) over the range variation must finite. 
This being true then always determine the constant integration 
that this area unity. 

The range each case taken the maximum one for which (1) and (2) 
may secured which contains the point, 


the Handbook, pp. 103, 104. 
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seems best follow the Handbook disposing three the transitional 
types before proceeding the main types the system and then the remain- 
ing transitional types. 

The discussion planned embody direct and uniform method treat- 
ment, giving simple formulae for the calculation the parameters terms 
and each case, and noting the salient features each type curve. 
The criteria for each type are expressed terms and which for the 
whole system permit simple graphical representation means the chart 
found the end this article. The construction this chart made clear 
the deviation the criteria. 


Transitional Type: The Normal Frequency Function: 


this case (1) reduces to, 


from which 


(N) 


shall refer the see that this function corresponds 
but single point. 

may have the appearance reasoning circle use the values the 
parameters given (3), which were derived from (2), solving (1) and then 
for the solution obtained examine the validity (2). However, may argue 
follows: will use the relations (3) definitions bo, and bein 
terms and which are not yet defined. Using the values and the 
given any choice and solve (1). the solution such that for 
(2) may derived, then the relations (3) are valid when and have their 
usual meanings. For convenience let denote the conditions for the validity 
(2) (A). obvious that conditions (A) are satisfied for 


(N) 


Transitional types 


get here (See the Handbook, loc. cit.): 


readily verified that, since conditions (A) are satisfied. 


t? 

1 

Shs 


CHART FOR PEARSON SYSTEM FREQUENCY CURVES 


with infinite ordinate —A. For the bell-shaped curve the mode 
falls —1/A and the mean—the mode 1/A a;/2. 


e! 
which represents J-shaped curve with the range (—1, 
For the function has been designated type III, the special case 


type the the points corresponding type III functions 


fall the line the type functions being represented single point 
this line. 


Turning now the discussion the three main types, note that for 
always which can write the form 


which neither nor can zero (since 0), and 
(4) 
— VD 


Leaving aside the special case, dealt with later, can always 
solve (1) the form 


with 


(6) 


the r’s are complex; and for and 2), the are real and 
the same sign. These three conditions with the additional condition that 
give rise respectively the main types frequency functions designated 
IV, and VI. The points corresponding them fall simply determined 
areas the boundaries these areas, the curve, 
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which intersects the type and type areas, and the line, 
1/2 


contain the points which correspond the transitional types. 


The range taken and (5) written 


evident that the area under the curve over this interval finite only 
all orders exist. this case also conditions (A) are satisfied. Now 


and the present case 


the points for correspond frequency functions,—they fall the 
Area.”’ 

Further the type curve will U-shaped, J-shaped, bell-shaped both 
m’s are the m’s are opposite sign, both are have 


only 


| 


CHART FOR PEARSON SYSTEM FREQUENCY CURVES 


which leads the condition: 


Also, 


Thus the curve, 


being tangent the line —3, divides the type area the chart 


into three parts: Above lie the points corresponding U-shaped curves, 
the right the points corresponding J-shaped curves, and below 


the points corresponding bell-shaped curves. (Note that the 


curves are always U-shaped.) 

opposite that for curves with mode. Finally the constant deter- 
mined setting 


giving 


this case write: 


With this notation (5) becomes 


vi 


| 
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and since, 


ci 


the frequency function can written, 


can always taken lie between and and that the range can now 

taken 
the previously discussed cases which the area under the curve 

was finite moments all orders existed. the present case, the area and the 

first four moments are always finite but this may fail true moments 


for f(t) given (IV) will finite for and infinite for 5if 
order for the n-th moment exist must have 


and the integral, 


Pearson designated heterotypic those members his system frequency 
functions for which the eighth moment failed exist. (In such case the 
standard deviation the fourth moment samples would 

was apparent that conditions (A) were satisfied for (It 
will appear below that the case which exception.) For 
will seen that generally true, the present case, that the formulae 


( 


CHART FOR PEARSON SYSTEM FREQUENCY CURVES 


determine setting the integral (V) over the interval 
equal unity, get 


C g2m-1 
which 
/ 
0 


The conditions specify the remaining area the chart. This may left 
the form 


Now and are both opposite sign a3, which, usual, will consider 


note that 
since now and that 


has the same sign Finally 
The range taken ©), the curve being bell-shaped when 
Since 


the area and the first four moments always exist. order for the n-th moment 
finite, must have 


—(m 


which the same condition the case the type function, giving the 
same deadline, 2/5. 


Tables for Statisticians and Biometricians, Cambridge Univ. Press, Part 2nd 
edition (1924), 


if 
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the origin shifted the point, r2, have writing, 

for the type function the expression, 


with the range (a, ©). Finally 


this case, 


The frequency function special case type setting, 


can write the form, 


the type case, the area and moments not exist for —1; for 
is, course, (—S, 


This function may regarded special case type IV, with 


follows once from the recursion formula, 
obtained from setting the expressions (3) (2), that changing the sign a;, the signs 
all the odd moments are changed. 


any = 


4 
4 
7 
i q 
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CHART FOR PEARSON SYSTEM FREQUENCY CURVES 


and write the function: 
The type VII function may equally well derived from the type function 
noting that 

The range however and for 2/5 the function heterotypic. 
Finally 


Here 


and return (1) derive the form the function, writing it: (The type 
can also derived limiting form type VI) 


integration get 
C(t 4. r) bee bolt+r) 
2(1+2 


2r(m—1) 


(V) 


note that has the same sign and that 1/6. The range 
shaped. order for the n-th moment exist must have always when 


[2r(m 


when —2m, and the frequency function becomes 


a 
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The range the curve being J-shaped with infinite ordinate 


The function 


the range still being the curve being J-shaped with finite ordinate 
the same value the type VIII case. 


and may write 


with the range still The curve J-shaped with finite ordinate 
Again, 


Transitional Type XII: 


the four linear equations derived from (2) from which the values 
bo, and (3) are derived are inconsistent. can however set the 
values (3) the differential equation (1) and from its limiting form 
derive the function appropriate this case. 


obtain 
with 


integration, 


| 
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CHART FOR PEARSON SYSTEM FREQUENCY CURVES 
which 


observe that (a3 


Taking the range r2), write, 
(XII) 


the curve being J-shaped. Here 


The values the parameters and the form the function can also derived 
Finally note that for (XII) reduces 


y=C 


thus including the rectangular distribution function among the Pearson system. 

the course the above discussion system criteria for the various 
types functions has been set terms and terms which 
every case the parameters may readily calculated. The which 
makes these criteria visual comparatively simple construct and strik- 
ingly simple appearance. Besides the lines, 


and 


contains only the curves 
which the points corresponding the type function lie, and the curve, 


which the points corresponding the functions types VIII, and 
are found. must take occasion express thanks Mr. Simon Yang 
who constructed this chart for me. 
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HETEROTYPIC AREA 


THE CHART FOR THE PEARSON FREQUENCY CURVES 
(The subscript refers bell-shaped curves) 


THE UNIVERSITY MICHIGAN. 
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RANK CORRELATION AND TESTS SIGNIFICANCE INVOLVING 


AND MARGARET RICHARDS PABST 


Dependence Tests Significance Normality 


The powerful tests significance, the work Fisher, which have 
been revolutionizing statistical theory and practice, are the main based 
the assumption normal distribution hypothetical population from which 
the observations are random sample. The nature and extent the errors 
likely result from the application test significance assuming normality, 
where normality does not really exist, have been the subject investigations 
both experimental and which however have not produced 
satisfactory substitutes for Fisher’s methods. false assumption normality 
does not usually give rise serious errors the interpretation simple means, 
since the distribution mean any considerable number cases very 
nearly normal, matter what the nature the parent population, long 
does not fall within certain class having infinite range, and including the 
Cauchy distribution. The sampling distributions second-order statistics are 
however more seriously disturbed lack normality, evident from their 
standard errors. For example the variance (u, sample variances 
much affected differs considerably, often does, from the value 
which takes for normal distribution. Likewise the approximate variance 
the correlation coefficient, 


r 


Research under grant-in-aid from the Carnegie Corporation New York. 

Presented the American Mathematical Society New York, Oct. 26, 1935. 

1J.L. Carlson, Study the Distribution Means Estimated from Small Samples the 
Method Maximum Likelihood for Pearson’s Type Curve, Unpublished Thesis, 
Leland Stanford Junior University, 1931. 

Leone Chesire, Elena Oldis and Egon Pearson, Further Experiments ihe Sampling 
Distribution the Correlation Coefficient, Journal the American Statistical Association, 
June, 1932, pp. 121-128. 

Victor Perlo, the Distribution Student’s Ratio for Samples Three Drawn from 
Rectangular Distribution, Biometrika, Vol. Parts and II, May, 1933, pp. 203-204. 

Paul Rider, the Distribution the Ratio Mean Standard Deviation Small 
Samples from Non-Normal Universes, Biometrika, Vol. XXI, Parts December, 1929, 
pp. 124-143. 

Rietz, Note the Distribution the Standard Deviation, etc., Biometrika, Vol. 
1931, pp. 424-426. 

Shewhart and Winters, Small Samples—New Experimental Results, Bell 
Telephone Laboratories, Reprint B-327, July, 1928. 
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different from the value p?)?/n commonly used, which reduces the 
population has the bivariate normal distribution. however remarkable 
that the variates are really independent, that and this 
formula reduces 


(1) 


regardless the form the distribution. should course remembered 
that these formulae give only the first term expansion inverse powers 
and also that the standard error fails for small samples characterize the 
distribution adequately. But the sensitiveness the standard error formula 
deviations from normality the population symptom the grave dangers 
using even those distributions which for normal populations are accurate, 
the absence definite evidence normality. 

substitute standard error formulae values the higher moments esti- 
mated from the data does not meet the difficulty satisfactorily, since these higher 
moments are themselves subject sampling errors which are often large, and 
since exact distributions can ever obtained this way. The use 
arbitrary system distributions such the Pearson curves subject the 
same criticisms that the normal distribution. These and other special 
distributions may indeed justified special cases general reasoning; 
example this introducing measure relationship other than the correlation 
tistical Methods for Research But for great deal statistical work 
such priori reasoning available and sufficient specify distribution 
sufficient detail. specific form distribution other than the normal can 
relied particular case, the mathematical problem finding the exact 
distribution the appropriate statistic will still commonly found difficult 
impossible. 


Tests Independent Normality Assumptions 


set problems thus encountered regarding the nature and methods 
statistical inference possible without assuming any particular distribution the 
variates the population from which have sample. Tests significance 
underlying such inferences must clearly invariant under all transformations 
each variate. are thus forced rely for our information relations 
order, qualitative classification, rather than upon magnitudes, excepting 
insofar can use inequalities such that Tchebycheff. Classification 
leads the use contingency tables, from which accurate probabilities are 
calculable for testing whether not the two more principles cross-classifica- 
tion used are independent. the probability obtained small render 
incredible that independence exists, the further problem arises measuring 
the degree relationship; but the absence special assumptions, such that 


RANK CORRELATION AND TESTS SIGNIFICANCE 


the bivariate normal distribution, those Fisher’s genetic example men- 
tioned above, the problem measuring degree relationship insoluble. Any 
measure degree relationship will change its value, unless this value corre- 
sponds independence, when transformations other than those restricted 
class are applied one the variates. The problem measuring degree 
relationship, correlation, thus quite different character from that 
testing the existence relationship, which equivalent absence inde- 
pendence. The existence correlation may detected methods rank 
order classification; these can never, themselves, sufficient for its 
measurement. 

test the deviation the center symmetrical population from some 
definite hypothetical value, Student’s distribution, which appropriate when 
the population normal, may replaced the binomial distribution, which 
will sometimes show that the preponderance cases one side the hypotheti- 
cal value too great admit the hypothesis. Fisher applied this principle 
Student’s original example, showing the same time that can certain cases 
used test the significance the difference between the means two 
Both this type test and the use contingency tables with grouped 
values variates bring out clearly the fact that abandonment the assumption 
normality equivalent certain loss information, larger samples being 
required make for the lack knowledge the form the population. 
The loss information greater for contingency tables arranged according 
the values the variates than when appropriate method rank correlation 
used, for the contingency table may regarded derived from the ranks 
grouping them, thus discarding some the information. 

shall illustrate combination rank and contingency methods 
suitable for utilizing simultaneously two kinds information contained 
grouped data. 

For large samples method treatment for which great deal said 
many cases consists replacing the observed variate new variate which 
value assigned for each individual frequency class interpolation 
table the normal probability integral, such way that the distribution 
the sample approximates normality. this done for each two variates 
which not have the bivariate normal distribution, the transformed values 
and may also lack the bivariate normal distribution, even approximately, 
though each normally distributed, far can speak sample being 
normally distributed. Even the bivariate distribution normal, the correla- 
tion coefficient and will not have the same distribution the correlation 
coefficient samples drawn from bivariate normal distribution, since the 
latter case the distributions and separately would most samples less 
nearly normal than when the transformation approximate normality 
applied. From these considerations follows that for the detection correla- 
tion the normalizing transformation cannot said general the best 


Fisher, Statistical Methods for Research Workers, Art. 24, end. 
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method, even for large samples, though may useful preliminary the 
application the method least squares the use correlation coefficients 
significantly different from zero certain cases. 


The Rank Correlation Coefficient 


Suppose that individuals are arranged two orders with respect two 
different attributes. Thus might arrange freshman class order according 
their grades language examination, and also according their mathemat- 
ical grades. another example, might able obtain ratings various 
states with respect penal law practice, and also with respect amount 
crime. Continuous variates expressing these qualities are likely not nor- 
mally distributed, that the product-moment correlation coefficient cannot 
expected have the exact distribution known for the case samples 
from normal population. may therefore resort the ranks, ignoring any 
exact values that have been assigned. 

Calling the rank the 7th individual with respect one attribute, and 
his rank with respect the other, that (Xi, Xe, and 
are two permutations the numbers (1, --- n), let put 


The rank correlation coefficient defined 


the sums being over the values the sample. Now since the sum the first 


integers n(n 1)/2, and the sum their squares n(n +1)(2n 1)/6, 
have 


and has the same value. Also, put for the difference between the 
two ranks for the individual, that 


(3) 


have 


Substituting (2) the value found frem this equation, and also the values 
just obtained for and have: 
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(4) 


This the most convenient formula for computing r’. 

Compared with certain other tests correlation based order, such 
the number inversions required pass from one permutation the 
numbers the other, appears sensitive index relationship, since for 
given value possesses greater number distinct values. But 
assert without qualification that any other statistic the best possible test 
correlation based order relations alone would meaningless. Indeed, 
particular type bivariate distribution might well have parameter represent- 
ing correlation whose significance could best detected test adapted only 
this particular bivariate distribution. However the rank correlation coeffi- 
cient has properties that point its value more general use than has hereto- 
fore received. has been regarded chiefly more easily calculable substitute 
for the product-moment coefficient Karl Pearson has remarked that the rank 
correlation coefficient the easier compute for samples smaller than approxi- 
mately forty, while involves less labor for larger samples. 

The great value the rank correlation coefficient appears consist 
its use test the existence correlation, test capable exact interpreta- 
tion terms probability, without any assumption normal other special 


the condition independence that shall the product function 


using the inner integral sign each case correspond the inner differential, 
then each the quantities and distributed with uniform density from 
The correlation with may called the rank correlation and 
the population. will vanish case independence. for this case 
that shall obtain §§5, and the exact probability test for small 
samples, the exact standard error and fourth moment, and asymptotic values for 
the higher moments, with demonstration that, for sufficiently large samples, 
and simplified form, certain work Karl Pearson relative the estimation 
the correlation bivariate normal distribution, and apply the results 
discuss the question the importance the lost information when measure- 
ments are replaced ranks. 


History Rank Correlation Theory 


Rank correlation seems have had its origin the method representing 
the distribution variate grades percentiles introduced Francis 
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Later Spearman‘ proposed that rank considered place the 
variate, and suggested that the correlation ranks used measure the 
degree dependence the variates. Spearman also introduced the 

The principal memoir rank correlation Karl Assuming 
underlying normal distribution, Pearson obtains relation equivalent 


where the correlation and the population, and the correlation 
the rank correlation r’, accordance with (6), writing 


(7) 
Pearson finds the first few terms infinite series giving the standard errors 
and r’’. deals similarly with the estimation correlation means 
The paper contains neat proof, attributed Student, the probable 
error under conditions independence. was this proof that sug- 
gested the analysis §§6 and below. This long memoir very difficult 
read and interpret accurately, owing chiefly the failure distinguish clearly 
between sample and population. 

The use the probable error formulae valid only the distributions 
and are sensibly normal. The question approximate normality thus raised 
investigated for the first time the present paper. order use these 
formulae necessary assume not only (1) that the underlying population 
has the bivariate normal distribution (an assumption which requires more than 
that each variate normally distributed), (2) that the first few terms the 
infinite series are enough, and (3) that the distributions and r’’ are practi- 
cally normal, but also (4) that sample values can put for population values 
the formulae, that population values are known independently can 
assumed. probably this last condition that has been least understood and 
has led the greatest number false conclusions regarding the significance 
data. 

the probable errors and all differing from each other and from Pear- 


Francis Galton, Natural Inheritance, Macmillan, 1889, Chaps. and 
Spearman, The Proof and Measurement Association Between Two Things, American 
Journal Psychology, Vol. 15, 1904. 

Karl Pearson, Further Methods Determining Correlation, Drapers’ Company 
Research Memoirs, Biometric Series IV, Mathematical Contributions the Theory 
Evolution, XVI, London, Dulau, 1907. 

Eells, Formulas for Probable Errors Coefficients Correlation, Journal the 
American Statistical Association, Vol. 24, 1929, 170. 


RANK CORRELATION AND TESTS SIGNIFICANCE 


son’s. Taking Pearson’s formulae correct, without discussing the assump- 


tions implicit their use, Eells presents table for calculating the probable 


Significance Rank Correlation Small Samples 


the variates are independent may without loss generality assign the 
any one the permutations these numbers, all permutations being 
equally probable. The probability any particular value thus propor- 
tional the number permutations giving rise this value. These may 
enumerated with the help Thus for each the values has 
respective probabilities 1/6, 1/3, 1/3, For the values 4/5, 3/5, 
2/5, 1/5, have the respective probabilities 1/24, 1/8, 1/24, 1/6, 1/12, 1/12. 

From (2) evident that the distribution case independence 
symmetrical, since each permutation exactly probable that directly 
opposite order, and since change sign all the y’s changes the sign 
without affecting its absolute value. clear also that the values +1, 
corresponding the two variates being the same opposite orders, are the 
extreme ones, and have each probability 1/n!. The next greatest value 
corresponds the interchange two consecutive individuals, who may 
with probability 1)/n! each. Next these, corresponding 
are the values +(1 whose probabilities are each 
2)(n 3)/2(n!), since the numbers pairs mutually exclusive consec- 
utive pairs sequence 2)(n 3)/2. like manner, but with 
greater complexity, appears that the probability the value 
great greater than the value then for samples 
impossible obtain significant value; for significance requires that 
the less stringent standard .05, unit correlation only significant 
sample while 29/35 not, but 31/35 is, significant sample 


The Standard Error and Fourth Moment 


For large samples the exact calculation probabilities becomes very laborious, 
and are forced resort approximations. The first step the available 
approximations the determination the standard deviation the distribu- 
tion. The square this quantity, the second moment variance r’, may, 
since the mean value case independence zero, written 
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the symbol denoting the expectation mean value the quantity following. 
The operation has the properties that the expectation sum the sum 
the expectations the terms, the expectation the product independent 
variates the product their expectations, and the expectation the product 
constant variate the product the constant the expectation 
the variate. particularly noted that the first these properties holds 
whether the terms the sum are mutually independent not. 
From (2) and (3) have 


(8) 
Now may regard taking the same values all samples, these 


values being centered zero and differing consecutively unity. The y’s are 
then variates, not independent each other, taking this same set values, but 
manner varying from sample sample chance. For any particular 


for example that associated with the chance distribution has moments the 
form 


denote the sum the pth powers the numbers differing consecu- 
tively unity and centered zero. clear that, for every odd value 
Also, from (3), 


view these facts, have from (8), 


where stands for the sum all the n(n 1)/2 different terms obtained 
permuting the subscripts. have 


also 
2 


Combining these results have: 


(10) 


This the formula obtained Student and incorporated Pearson’s memoir. 
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Any desired moment may obtained this manner. However the 
complexity the calculation increases rapidly with the order the moment, 
and the derivation even the fourth moment too long included this 
paper. The value obtained for the fourth moment 


will observed immediately that the kurtosis, approaches the 
normal value increases. 

For values which are not small enough for the exact 
computed easily, the Tchebycheff inequality, 


where the probability deviation exceeding r’, will often 
Thus, and .9, (11) shows that less than .05, that the 
evidence for existence relationship should ordinary standard re- 
garded significant. However this does not general give accurate 
approximation nor the similar inequalities involving the higher moments. 


The Higher Moments and the Approach Normality 


19, 1 
2 


When the parenthesis expanded may take the expectation term term, 
regarding the constants. Now 
and forth, the sums the right the numerators being symmetric functions 
the constants taken over all different terms obtained from that written 


permuting subscripts, and the denominator being each case the number 
terms the numerator. Thus 


determining the leading term the expansion powers shall 
select the term the curly brackets (13) highest degree, meaning the 
degree one these rational fractions the excess the degree the numerator 
over that the denominator. 

The symmetric functions are well known expressible polynomials 
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the power-sums each term such polynomial corresponding one 
our symmetric function degree 2a, the sum the subscripts the s,’s must 
2a, since all the are multiplied constant such polynomial must 
multiplied the power the constant. Now polynomial degree 
degree any the terms the polynomial the power-sums must exceed 
the number power-sums appearing thisterm. Therefore, the term 
highest degree obtained, when one the symmetric functions expressed 
terms the s,’s and thence terms must contain the greatest possible 
symmetric functions, this function may written the form 


(14) 


where --- 2a,and thec’sdonotinvolven. Inthe right-hand 
member the equation above, the first term involves the power-sums, while 
the remaining terms involve fewer them. Hence, --- 
are even, the first term polynomial degree while the remain- 
ing terms are polynomials lower degree, and are therefore negligible compari- 
son with the first term when sufficiently large. But any the indices 
are odd, the first term vanishes identically, and the degree (14), regarded 
polynomial then less than Since the sum the indices 2a, the 
number odd ones among them must even; let this number denoted 
and let the number even indices Then The terms 
highest degree the right-hand member (14) must obtained grouping 
the odd indices pairs form the subscripts the s’s. The degree therefore 

(13), the degree the denominator each term the curly brackets the 
number distinct appearing term the symmetric function the 


numerator, namely Hence the excess the degree the numera- 
tor over that the denominator 


This will maximum when maximum, and independent The 
maximum value and occurs only for the symmetric function 


(15) 


The term involving this function therefore the only one the right-hand 
member (13) need consider. Since this symmetric function contains 
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the coefficient is, the multinomial theorem 
have from (13), 


evaluate the symmetric function (15), far the term highest order in, 
concerned, course need only the first term (14), which reduces 
this case 


which therefore the reciprocal Thus obtain 


(2a)! 


the terms dropped being higher order 


The 2ath moment the quotient its standard error, that is, 
the value 


(2a)! 


(16) 


The odd moments are all zero because the symmetry the distribution r’. 
But (16) the moment order normal distribution unit variance and 
zeromean. follows therefore from the Second Limit Theorem Probability’ 
that the distribution tends normality increases; that is, for any real 


dz. 


The normality the limiting distribution the rank correlation coefficient 
rather remarkable, since r’, unlike the product-moment correlation coefficient 
other statistics common use, neither mean independent quantities 
nor function such means, that the ultimate normality just established 
not corollary known general theorems. unexpected also because the 
exact distribution for samples smaller than six might lead one anticipate 
bimodal distribution. 

outstanding problem determine whether the distribution 
samples from bivariate normal distribution for which converges nor- 
mality. Without such approach normality, the probable error formulae 


First proved Markoff. Cf. Fréchet and Shohat, Proof the Generalized Second 
Limit Theorem the Theory Probability, Transactions the American Mathematical 
Society, Vol. 33, 1932, pp. 533-543. 
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discovered Pearson are useless. Another problem find convenient and 
accurate approximations the distribution r’, for moderate values with 


close limits error. table calculated along the lines suggested would 
very useful. 


Combination Rank and Contingency Methods 


Suppose that thousand school children are examined the end course 


instruction, and rated with the grades and Five hundred 
these children are each sex. The results are: 


Totals 


220 


200 
200 


500 
500 


410 400 140 1000 


Regarding this contingency table with three degrees freedom, 
calculate 7.52, the probability which value being exceeded chance 
.0570. The indications significant difference distribution grades 
between sexes may thus, one holds the .05 standard and uses only the 
test, regarded not quite significant. There is, however, additional evidence 
the fact that the proportion girls diminishes steadily pass down the 
grades. treat excellence the subject one variate and the 
proportion girls group another, have rank correlation unity, 
with sample four. The probability correlation .083, which 
also, itself, would not considered significant. But may combine the 
two pieces evidence the method given The process consists 
adding the natural logarithms the two probabilities, doubling, and treating 
the result having the distribution with four degrees freedom. 
probability the neighborhood .03, which would judged significant. 
Similar cases are very common. The value unchanged the columns 
are permuted any way, whereas depends solely which the possible 
permutations actually exists. Thus the two tests are independent, property 
needed for the combination the-above method. 


Efficiency Replacement Measures Ranks, and the Estimation 
from Rank Correlation, for Normal Population 


Consider population with normal distribution two variates and 
each which shall without loss generality assume unit variance 
and The density distribution then specified dy, where 


Fisher, Statistical Methods for Research Workers, 4th and 5th editions, Art. 21.1. 
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V1 


§3, denote the uniformized variates defined (5), functions re- 
Then and will each have the variance 1/12. The rank correlation the 
population the correlation and consequently 


From (17) the identity 


(19) 


readily With its help have from (18) and integrations parts, 


Now since and are normally distributed with unit variance and zero means, 
the uniformized variates (5) take the form 


Substituting these values and (17) the last integral (20) have, 


The double integral, well known, equals divided the square root the 
discriminant the quadratic form the exponent. This gives 


(20) 


Therefore 
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Therefore, since vanishes with 


, 


This essentially the process used Pearson. 
The last equation suggests that estimate r’’ based the rank 
correlation means the relation 


2sin 


Prefixing denote deviation sample from population value have 
Taylor expansion, 


the terms dropped being higher order than those written, and conse- 
quently higher order Squaring, taking the expectation, and ignoring 
the terms higher order, have for the case (10), 


1)’ 
approximately. 


The last result enables measure the loss information, least for large 
samples, that results from neglecting the exact values the variates and using 
only ranks. The product-moment correlation coefficient has, the 
exact variance 


This means that the product-moment correlation approximately sensitive 
test the existence relationship normally distributed population with 
cases the rank correlation with 100 cases. 

The efficiency will course different for non-normal populations, and 
also for normal populations with But the form the population 
known, this knowledge may always used supplement the ranks obtain 
more accurate estimate correlation, test relationship. This fact deserves 
some attention, since superficial observation the coincidence the formula (1) 
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for the leading term the variance arbitrary uncorrelated population, 
and the leading term the formula (10) for the variance the rank correlation, 
might suggest that accurate asr. But may surmised that the 
loss information found for the bivariate normal distribution the greatest loss 
information using place test for independence, since for non- 
normal populations the most efficient estimate the correlation will not usually 
but more complicated function the observations. Certainly where 
there complete absence knowledge the form the bivariate distribution, 
and especially believed not normal, the rank correlation coefficient 
strongly recommended means testing the existence relationship. 


UNIVERSITY. 
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THE ELIMINATION PERPETUAL CALENDARS 


wish find the day the week for any date, one way solve the 
problem use perpetual calendar. Another way solve the problem 
calculate the day the week mathematical methods. the past these 
mathematical methods have been complicated that has been much more 
convenient use perpetual calendar. This explains why some people have 
put themselves the expense buying perpetual calendars. The purpose 
this article provide mathematical method which simple that the 
entire calculation can done mentally and which convenient per- 
petual calendar. this article this mathematical method applied the 
Gregorian, Julian, and World calendars. Since great many records have 
been made using the Julian and Gregorian calendars, the adoption the World 
calendar would not completely eliminate the usefulness applying the mathe- 
matical method the historical calendars. The mathematical method also 
shows what extent the World calendar simplification; this important 
because proposals reform the present calendar are attracting world-wide 
attention. 

the theory numbers occurs the expression, 


(1) 


which read congruent modulo and which means that the differ- 


(2) 


Assume stands for any number which represents any monthday any 
month. Assume stands for any number which represents any day the 
week. assumed that stands for Sunday, for Monday, for Tuesday, 
assumed that the constant for any month the value the 
first Sunday that month. Then (2) becomes 


(3) 


which enables find known provided the constant known for 
the month question. Consequently, all need complete our theory 
discover method finding for any possible month. 

First, there will discussed rules for finding for any month the Gregorian 
calendar 1935. inspection the calendar shows that for December 
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equal Since November has days, can find for adding 
which congruent 30, the for December. Since the number days 
September, October, and November 91, which congruent zero, the c’s 
for September and December have the same value. like manner, since 
for September the for June and the for March now have 
all the theory which necessary find any date 1935. For example, 
suppose wish find for April 17, and know that the for December 
Then, adding find that the for March are now position 
easily calculate that the for April Applying (3) find that 
April which stands for Wednesday. 

All that necessary complete our theory the Gregorian calendar 
find rules for finding for December any possible year, because, this 
known, can find for any month that year the method used for 1935. 
convenient represent the expression, for December 1935” for 
like manner for any calendar year means for December that 
year. Since for 1935 and since the number days 1936 366, which 
congruent Knowing for 1936, deduce that for 1940, which 
found subtracting The C’s for 1900, 1928, 1956, and 1984 are equal. 
Full centuries order leap years must divisible 400. Since 
for 1900 find adding that for 2000 Knowing for 2000, 
deduce adding that for 2100 1600, 2000, and 2400 have the 
same value assumed that the length the tropical year exactly 
365.2425 days, have all the theory which necessary find for any 
possible year. Although this assumption contains small error, any further 
discussion would hardly any practical interest. The foregoing theory 
provides complete methods for finding means series steps, which 
are simple that the entire calculation can done mentally. For example, 
suppose wish find for November 29, 1888. Each the C’s for 1800 
29, 1888 which stands for Thursday. order calculate mentally 
for any date the Gregorian calendar, only necessary for remember 
the foregoing mathematical method and remember was born November 
29, 1888, Thanksgiving Day. 

Deplorable changes were made the Julian calendar between B.C. and 
Also was not until 325 A.D. that the use the 7-day week became 
general throughout the Roman Empire, gradually supplanting the old division 
the month into Calends, Nones, and Ides. Therefore, order save space, 
the application our theory prior A.D. left the reader. Starting 
with this year only necessary discover rule for finding the C’s the 
Julian calendar for the full centuries, because the rules the Gregorian calendar 
apply all other years. October 1582, Old Style was the same day Oc- 


: 
z 


JOHN ROBERTS 


tober 15, 1582, New Style; the Gregorian calendar was born this date. De- 
cember 17, 1600, New Style was Sunday, and was the same day December 
1600, Old Style. Therefore, for 1600, Old Style now very simple 
matter complete our theory the Julian calendar. Since for 1600 
subtracting for 1500 200, 900, and 1600 have the same value 

the case the World calendar the c’s for the three months each the 
equal quarters can found follows. For the first month There- 
from this find that for the third month 


NOTES 


STANDARD ERROR FOR THE LINE MUTUAL 
REGRESSION 


Pearson’s Lines and Planes Closest Fit System Points Space, 
establishes formula for the mean square residual for the best fitting line 


where the length the maximum axis the correlation ellipse 


the present paper, consider 2-dimensional case, and shall call the mean 
sq. residual the standard error, denoted 
2-dimensional space, correlation ellipse 


where 

Pearson gives the 2-dimensional space the following formula for Sy: 

(3) axis equation (2). 


Expression (3) can readily deduced from (1). This paper aims present 
some formulae for Sy, more convenient for practical computation, and also call 


attention misprint Pearson’s paper. 


From analytic geometry, see that the angie between the major axis 
the ellipse (2) and the z-axis given 


(4) tan 2h/(a b). 

rotation the axes, equation (1) can written the form 

where 


(5a) 


b’ 


Philosophical Magazine, 6th Series, (November, 1901), 559. 
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The value given (5a) less than b’. 
prove this lemma, find from (4) and (5) 


and hence 


Since both and are positive, the lemma will proved can show that 


pendent the sign rzy. 


The square the mean square residual equal a’, and hence 


For from (5), obtain (semi-major —c/a’ Substituting 


this into (3), obtain The balance the lemma follows from (5a), 
(6), and (2a). 


ment given the demonstration Lemma see that and sin should 
the same sign. Hence the negative sign chosen before the radical. 
From Lemma and (7), have the formula given Pearson: 


are going establish several more formulae for Sy. From (4), 
have 2h-tan —(a The sign before the radical deter- 
mined such way that tan has the same sign the reasoning 
given Lemma the negative sign chosen. Thus 


This proves that 
(9) 


STANDARD ERROR FOR LINE MUTUAL REGRESSION 


Similarly, have 


For computation, (9) and (10) are more convenient than (8). When the line 
equal the slope that line, and hence cot 1/B) equal the reciprocal 
the slope. Then can write (9) and (10) follows: 

(12) Sk Poy/B. 

The second formula given Lemma simpler than (8), but not simple 
(11) and (12). 

For computation, convenient find from the equation 


arctan 


Since sin and are the same sign, can determine the value from 
the preceding equation inspection, though arctan multiple-valued 
function. After the determination can obtain 


tang. 


Then can compute either from (9), (11), (10), (12). 
There very interesting fact furnished (11) and (12). These two 
formulae are, fact, generalizations the following two well known ones: 


(b) 


where the standard error the line regression when used dependent 
variable and independent variable, and similarly for S,. clear that the 
line mutual regression may looked upon generalization the other 
two lines regression when use dependent variable. the slope 


variable, then must obtain instead Hence substituting the formula 
instead into (11), obtain, after simple reduction, the same result 
given (a). the other hand, use independent variable, 
must obtain instead 1/B. will result (b) when put the place 
1/B (12). The generalization perhaps can seen more clearly write 
(a) and (b) into slightly different forms: 
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(b’) 


The misprint Pearson’s paper the second formula the following: 


axis ellipse (2).” Henry Schultz first noticed this misprint and 
suggested the writer investigate it. 

recent letter Schultz, Pearson pointed out that one the simplest 
formula for (MSR)? given 


where defined Professor Schultz expressed doubt about 
its validity. From lemma clear that also not true. 
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THE DISTRIBUTION LAWS THE DIFFERENCE AND QUOTIENT 
VARIABLES INDEPENDENTLY DISTRIBUTED PEARSON 
TYPE 


KULLBACK 


Although the results herein described are not entirely new, felt that the 
method solution interest presenting further illustrations the applica- 
tion characteristic functions the distribution problem statistics 


Distribution law the difference. Let where the distribu- 
tion laws and are independent and given respectively 


y yt 
The characteristic function the distribution law given (1), 
(3) 


The distribution law given (1), 


dt 


Now may shown that (1) 


Presented the American Mathematical Society, June 20, 1934. 
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where the confluent hypergeometric function (2). 


Since 
have finally 


(2u). 


where the Bessel Function 


the second kind and imaginary argument (1), obtain 


2p—1 
2 


This result has been otherwise obtained Pearson, Stouffer, and David (3). 


Distribution law the quotient. 
are defined above. 


The characteristic function the distribution law given (1) 


(10) 


The distribution law given (1) 


Now may shown that (2) 


that 
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obtain 


(15) 


which result has been otherwise obtained Fisher (4). 


GEORGE WASHINGTON UNIVERSITY. 
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REPORT THE MEETING THE INSTITUTE 
MATHEMATICAL STATISTICS ST. LOUIS 


The Institute Mathematical Statistics held joint meeting with the 
Econometric Society and the American Mathematical Society St. Louis, 
Missouri, January 1936. The program consisted invited address, 
Mathematical Theory Index Numbers,” Professor Thomas Rawles, 
and the following additional papers: 

(1) Certain Distributions Derived from the Multinomial Distribution, 

Dr. Solomon Kullback 
(2) Convexity Properties Generalized Mean Value Functions, Dr. 
Nilan Norris 

(3) The Frequency Distribution for the Mean Independent Chance 
Variables When Each Subject the Law Prof. 
Baten 

(4) the Admissibility Time Series, Prof. Francis Regan 


The Institute voted hold meeting Cambridge, Massachusetts, early 
September this year. This meeting will connection with the celebra- 
tion the Harvard Tercentenary. Professor Fisher will deliver 
invited address before the Institute and the American Mathematical Society. 
more detailed announcement the meeting will made later. 
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